Digital musical instrument system

ABSTRACT

The present invention provides an interactive multimedia apparatus ( 1, 11, 21 ) comprising a digital musical instrument ( 3, 14, 24, 41 ) and having a plurality of control members ( 42, 44, 45, 46 ) including at least one limited state (on/off) control member ( 44 ) and one or more dynamic range state control members ( 42, 45, 46 ). A central control unit ( 2, 12, 22 ) is also provided having a store of digital media stored thereon and a suite of software for interpreting the state of the control members ( 42, 44, 45, 46 ) in order to select, open and render the digital media. A control unit is associated with the digital musical instrument ( 3, 14, 24, 41 ) and has a CPU and a sensing means for identifying the state of the control members ( 42, 44, 45, 46 ). The control unit has means for communicating the current state of the control members ( 42, 44, 45, 46 ) to the central control unit ( 2, 12, 22 ) and the apparatus is characterised in that the sensing means comprises a plurality of independent transducers each of which monitors the activation of a separate dynamic range state control member ( 42, 45, 46 ).

The present invention relates to an interactive multimedia apparatus.

The present invention is an improvement to invention disclosed inInternational publication number WO 01/95052 by the same inventor, thecontents of which are incorporated herein by reference thereto.

It is an object of the present invention to provide an interactivemultimedia apparatus which will provide users with a digital instrumentplatform allowing a wider range of more challenging experiences.Additionally, it presents users with a sophisticated digital musicalinstrument which will enable them to create musical and other multimediacontent as if they were accomplished musicians/artists. Additionally, itis an object of the invention to allow non-musical trained users tocompose, accompany, solo, gig and have fun as if they were anaccomplished instrument player. Finally, it is an object of the presentinvention to assist users in developing knowledge of chord structures,complex chord structures, voicing, scales and the fingering of notes onthe fret of stringed instruments.

Accordingly, the present invention provides an interactive multimediaapparatus comprising:—

-   -   a digital musical instrument having a plurality of control        members including at least one limited state (on/off) control        member and at least dynamic range state control member;    -   a central control unit having a store of digital media stored        thereon and a suite of software for interpreting the state of        the control members in order to select, open and render the        digital media;    -   a control unit associated with the digital musical instrument        having a CPU and a sensing means for identifying the state of        the control members, the control unit having means for        communicating the current state of the control members to the        central control unit;    -   a means for communications between the central control unit and        the CPU; and    -   the sensing means comprising a plurality of independent        transducers each of which monitors the activation of a separate        dynamic range state control member.

Advantageously, the provision of an independent transducer to monitoreach dynamic range state control member dramatically increases thefunctionality of the apparatus and further increases the interactionbetween an operator and the apparatus allowing an operator greatercontrol over the output generated by the apparatus.

Preferably, the independent transducers are selected from a group ofelectrical, optical, pressure, movement, magnetic and piezo-electrictransducers.

All of these types of transducers provide acceptable solutions for thesensing of vibrations, and the amplitude of the vibrations.

Ideally, the piezo-electric transducer is selected from a groupconsisting of piezo-electric crystal transducers, piezo-electric ceramictransducers and piezo-electric film transducers.

In a particularly preferred embodiment, the piezo-electric transducer isa piezo-electric crystal transducer.

Preferably, the digital musical instrument is a guitar/guitar typedevice.

Ideally, a number of the dynamic range state control members are stringsof a stringed instrument.

Preferably, each independent transducer monitors one individual stringand converts movement of the string into electrical signals.

Ideally, at least one dynamic range state control member is a footpedal.

Preferably, one or each foot pedal is monitored by a potentiometer.

Ideally, activation of the foot pedal dynamically modifies a variablecontrol such as volume, pan or special effect parameter controls.

Preferably, the central control unit has a visual display unit (V.D.U.)and the suite of software has a graphical user interface (G.U.I)displayable on the V.D.U.

Ideally, the control unit of the digital musical instrument has acontrol panel comprising a plurality of limited state control members,namely switches for navigating through the G.U.I. of the software suiteand also modifying the parameters of the software suite.

Preferably, the central control unit has memory for storing userassignments of digital media against specific control members using thecontrol panel, the memory being accessible by a software module of thesoftware suite in response to activation of a control member or byactivation of a combination of one or more limited state or dynamicrange state control members to open, render, modify, adjust, addeffects, change parameters and change controls of the rendered digitalmedia.

Ideally, indicators are provided on the digital musical instrument andare controllable by software on the central control unit in response toan assignment of digital media against specific control members by auser, the indicators being provided to show the user which of thedynamic range state control members have been assigned to produce anaudio/visual output if activated.

Preferably, the indicators are a plurality of light emitting diodesdisposed on the digital musical instrument below each string, eachL.E.D. being associated with one string.

Ideally, at least one limited state (on/off) control member and at leastone dynamic range state control member are provided.

Preferably, between one and sixteen limited state (on/off) controlmembers and between one and twelve dynamic range state control membersare provided.

Ideally, each control member is associatable with any file stored in thestore of the central control unit.

Preferably, at least some of the digital audio files are recordedinstrument notes from a plurality of stringed instrument types.

Ideally, the store further comprises a chord and scale store of digitalmedia containing the note associations for a wide range of defined chordand scale sequences, the store also defining the correct note associatedwith each string position for the selected chord or limited scalesequence so that the notes are played in the correct sequence when thestrings are strummed up or down.

Ideally, the central control unit has input/output connections for theInternet.

Preferably, the software in the central control unit detects the length,and amplitude and the frequency of the electrical signals received fromthe digital musical instrument in response to a control member'sexcitation and alters its rendering of the digital media mapped to thatcontrol member or any other control member in sympathy with thatexcitation.

The software always generates an output even if the user operates thecontrol members at the wrong time or incorrectly and in which theoutputs provided are sympathetic to the main track's structure andmelody.

Ideally, the digital media are rendered simultaneously with a CD, DVD orother primary source of music playing on the audio-visual equipment.Sound is generated in direct response to an operator's action, whichenhances the overall musical experience for the operator.

Preferably, the apparatus is provided with a series of special effectcontrols which when operated by a user send signals to the software toproduce a variety of special effects on the digital media output. Thereare a variety of different ways of manipulating sounds using effects.Frequencies of samples can be raised or lowered, resonance can bedistorted (overdrive) or echo can be added through delay and feedback.

Conveniently, the apparatus includes means for storing the newlygenerated output to any desired storage device such as a hard disk, acompact disc, a DVD device or the like.

Preferably, the apparatus includes a series of visual display screenswhich are operable to enable a user to launch a game experience, selectdifferent operating modes, choose a source music device, select abacking track and/or assign digital sound effects files to the specialeffects controls on the digital musical instrument.

Optionally, the digital media may contain a riff, a sample, a loop or atrack. A riff is a series of notes that form a section of a musicaltrack. A song might contain a guitar riff of eight notes followed by aseries of guitar riffs to form a lead solo. Some software music studioshave riff generators that allow the creation of unique riffs instead ofusing pre-recorded riffs. There are also different digital storageformats for riffs such as .wav and .mp3. A sample is a pre-recordedpiece of music that is usually not very long such as a five-second bassriff, or a two-second drum loop. Many CD's are available that offerthousands of royalty-free sound samples. A loop is a riff that whenrepeated over and over again forms a seamless track of music. A bassloop may contain a six-note riff that can be repeated a number of timesto form some of the bass-line of a song.

Preferably, the apparatus includes an interface for sending theelectrical signals generated by the transducers to the central controlunit, the interface being provided between the transducers and the inputport of the central control unit, the interface unit enabling the userto generate a plurality of different control signals to the centralcontrol unit.

Ideally, the interface includes an amplifier and level detectors todetect the force with which the user strums or strikes the strings. Thesoftware includes means to decipher the electrical signals from theinstrument and alter one or more parameters of the rendered media insympathy with the force of the string excitation.

Ideally, the interface unit is provided with a potentiometer whichvaries the duration of the sound of the digital media file.

Ideally, customised driver software is provided with the instrumentavoiding the necessity for calibration.

Preferably, the communication means deployed between the digital musicalinstrument and the central control unit is a Universal Serial Bus (USB).

Preferably, the central control unit comprises a personal computer, acable or satellite television decoder or a games console and theaudio/audio-visual means comprises a mono or stereo high fidelity audioapparatus, a television, a monitor or a like audio/audio-visual outputmeans.

In a still further aspect of the invention, an operator can use thedigital musical instrument and the software interface as a sixteen ortwenty-four track-recording studio. The studio allows an operator tosave their compositions in a format for future rendering and also in aformat for writing their own CD's. Other export formats are MP3 and wav.

Ideally, an operator can drop samples of riffs and loops onto individualtracks to compose their own music/songs. Bass loops, drum loops, rhythmguitar and lead guitar riffs and loops in different musical instrumentsare provided. Samples are available on CDs and can be downloaded fromthe Internet.

Preferably, the user will be able to set beats per minute BPM, createhis own riffs, loops, and effects and change the pitch of selectedsections. BPM stands for beats per minute and is also known as the tempoof a song, or in other words the speed at which a song is played.Different songs will have different BPM e.g. a lot ofTechno/Dance/Hip-Hop will have 130-180 BPM. It is important whencreating a song made up of sample riffs and loops that all the sampleshave the same BPM. Some software programs allow the transposition ofsamples from one tempo to another without changing the pitch of thesample.

Ideally, a number of digital musical instruments can be connected to thecentral control unit at one time allowing multi-user operation of theapparatus. One guitarist could control the lead guitar, another thebass, and another the rhythm guitar and roles could be switched whileplaying. In Jam mode, players could improvise by playing over speciallycomposed songs or by playing their own tracks/songs or by playing inrandom selection mode. In this mode a number of operators could have a‘battle of the bands’ competition against each other.

In another aspect of the invention, an operator uses the apparatus as alearning aid and has to strum to the correct tempo of the music as wellas making different track selections and adding the proper effects atthe right time.

In a further aspect of the invention, the apparatus is used as acontroller to bring the operator through different levels of a customdesigned computer game. The game plot could go through different levelsof becoming a rock star such as going to music school, learning to play,forming a band, writing songs, playing gigs, getting a manager,recording in a studio, getting a record deal, releasing an album,designing CD sleeves, making a pop/rock video, animations/clips etc,competing in the charts and all the various stages could be conducted asa competition over the Internet.

Most guitar players write songs initially as a sequence of Chords. Thereare numerous music books available to give the guitar tablature (Chords)for different music albums/styles. These could also be provided from awebsite.

The present invention is a combination of digital hardware and computersoftware program. It operates on mass market computer-based multimediaplatforms, i.e. personal computers or games consoles such as SonyPlaystation, Microsoft X-Box or Nintendo Dreamcast (APS Registered TradeMarks).

The digital media content for use with the invention can be anythird-party generated media that can be rendered on a personal computeror games console.

The content also includes discrete soundbites (effects sounds, i.e.riffs, beats, loops etc. selectable by the switches on the peripheral)that can be triggered during the playback experience.

The invention will now be described with reference to the accompanyingdrawings, which show, by way of example only, an interactive multimediaapparatus in accordance with the invention in which:—

FIG. 1 is a pictorial representation of a first embodiment ofinteractive multimedia apparatus;

FIG. 2 is a pictorial representation of a second embodiment of theinteractive multimedia apparatus;

FIG. 3 is a pictorial representation of a third embodiment of theinteractive multimedia apparatus;

FIG. 4 is a perspective view of a digital musical instrument provided inthis case by a guitar;

FIG. 5 is a front elevation view of the guitar of FIG. 4;

FIG. 6 is a side view of the guitar of FIGS. 4 and 5;

FIG. 7 is a rear exploded perspective view of the guitar of FIGS. 4, 5and 6;

FIG. 8 is a schematic diagram of a USB (Universal Serial Bus) device;

FIG. 9 is a schematic diagram of the remaining section of USB device;

FIG. 10 is a menu of all C chord variations held in the store;

FIG. 11 is a screen shot showing the instrument selection folder;

FIG. 12 is also a screen shot showing the instrument selection folder;

FIG. 13 is a screen shot showing a control member functionalityassignment screen;

FIG. 14 is also a screen shot showing the control member functionalityassignment screen;

FIG. 15 is also a screen shot showing a further control memberfunctionality assignment screen;

FIG. 16 is a screen shot showing a special effects assignment screen;

FIG. 17 is a screen shot showing a further special effects assignmentscreen;

FIG. 18 is a screen shot showing further options on the special effectsassignment screen;

FIG. 19 is a further screen shot showing a special effects assignmentscreen assigning special effects to specific control member;

Referring to the drawings and initially to FIG. 1 there is shown aninteractive multimedia apparatus indicated generally by the referencenumeral 1. The apparatus 1 comprises a central control unit provided bya PC 2 in this embodiment. The PC 2 can store any number of digitalmedia in any desired file format on a hard drive and has I/O connectionsfor a digital musical instrument provided by a guitar 3 in thisembodiment. The PC 2 also has an I/O connection for audio-visualequipment provided by an audio unit 4 and Internet access via a modem 5.Alternatively, the speakers 10, 10A and drive means (sound card) canform part of the PC 2.

Referring to the drawings and now to FIG. 2 there is shown a secondembodiment of an interactive multimedia apparatus indicated generally bythe reference numeral 11. The apparatus 11 comprises a central controlunit provided by a set top box 12 having a facility to store any numberof digital media in any desired file format downloaded over a cable TVmodem 13. The central control unit 12 receives electrical signals fromthe guitar 14. In response to electrical signals from the guitar 14, thesoftware of the central control unit 12 generates an audible outputsignal from the digital media to the audio-visual equipment 15 in directresponse to an input from the user of the guitar 14.

Referring to the drawings and now to FIG. 3 there is shown a thirdembodiment of an interactive multimedia apparatus indicated generally bythe reference numeral 21. The apparatus 21 comprises a central controlunit provided by a games console 22 having a facility to store anynumber of digital media in any desired file format downloaded over amodem 23. In response to electrical signals from the guitar 24, thesoftware of the console 22 generates an audible output signal from thedigital media file to the audio-visual equipment 25 in direct responseto input from the user of the guitar 24.

Referring to the drawings and now to FIGS. 4 to 7, there is shown oneembodiment of a digital musical instrument provided in this case by aguitar 41. The guitar 41 is provided with dynamic range state controlmembers in the form of strings 42 and five transducers 50 and lightemitting diodes (LED's) 52 disposed on the housing 43. Each transducerindependently monitors a separate string 42. It will of course beappreciated that a separate transducer 50 is provided for each dynamicrange state control member. A number of limited state control members 44are provided in addition to a dynamic range state control member in theform of a tremolo arm 45 for pitch, bending and creating a tremoloeffect. A further dynamic range state control member in the form of avolume control button 46 and a power indicating L.E.D. 47 are alsoprovided on the guitar 41. Also shown in FIGS. 5 to 7, a control panel48 is provided at the end of the arm 49 of the guitar 41 and is providedby four limited stated control members, namely switches.

In use, a user navigates through a G.U.I. of the software suite on a VDU(15, 25) using the control panel 48 and assigns specific files stored onthe store to one or more control members 42, 44, 45 46. Additionally,the user may apply various effects to either or both of the limitedstate control members 44 and the dynamic range state control members 42,45 46 which is more fully explained with reference to FIGS. 10 to 19below. Once file and effect assignments are made, the user strums theguitar 41 and each string 42 vibrates up through its own transducerdisposed on the housing 43. The transducers convert the mechanicalvibrations to an electrical signal and forwards the electrical signal toa USB interface unit (see FIGS. 8 and 9). The USB transmits the signalsto the central control unit (2, 12, 22) and in particular to thesoftware suite stored thereon. In response to electrical signals fromthe guitar (3, 14, 24, 41), the software opens a file containing avariety of sounds/images stored digitally and produces an output viaconnected speakers or V.D.U's.

If a user wishes to output sound from a different file, another limitedstate control member 44 must be pressed on the guitar 41. This in turnsignals the software to open a different associated file. If a userwishes to apply a special effect they can activate any control member42, 44, 45, 46 such as the arm 45 and volume control is achievable bytwisting volume control buttons 46. When a user becomes tired of thevarious files that they have downloaded onto the central control unit(2, 12, 22), they may select a different collection of files using thecontrol panel 48 in conjunction with a graphical user interfacedisplayed on the visual display. A user can directly access the internetusing the guitar 41 as a means for navigation.

Referring to the drawings and now to FIGS. 8 and 9, there is shown acontrol unit of the digital musical instrument, namely a USB (UniversalSerial Bus) implementation of the interface hardware for the InteractiveMultimedia apparatus (1, 11, 21), combined with a custom-designed suiteof software running on a central control unit (2, 12, 22), which willprovide the user with the facility to render the full range ofinstrumental chords by selection of pre-assigned control members (42,44, 45, 46) and the simultaneous activation of an individual controlmember string (42) or a plurality of string control members (42). Thisinvention allows non-musical trained users to compose, accompany, solo,gig and have fin as if they were an accomplished instrument player.

Additionally the invention will assist users in developing a knowledgeof chord structures, complex chord structures, scales and the locationof notes on the fret of a stringed instrument (3, 14, 24, 41).

This invention allows users to not only dynamically apply global effectparameters to a selected note or chord, but will allow users to select,control and adjust any individual or group of parameters which make-upthe component parameters of the selected special effect generator.

FIG. 8 and FIG. 9 show the schematic drawings for the USB (UniversalSerial Bus) Interactive Multimedia apparatus (1, 11, 21). Theexplanation of the circuit and its operation are as follows:

The guitar (3, 14, 24, 41) product is a USB low speed (1.5 Mhz) buspowered device. It has 12 pushbutton switches SW1 to SW12, 1 optoswitchOPT1/red LED 204SRC pair. It is connected to the PC via a 3 m 4 corescreened cable.

Schematic Description

Power

The guitar (3, 14, 24, 41) product receives its +5 volts power from thePC via USB connector CN1. The maximum current drawn will beapproximately 50 mA.

Hardware Reset

When power is first applied, the CPU will be reset by 2 off 0.1 uFcapacitors and 10 k resistor combination. Suspend Mode. All USB devicesmust support suspend mode. Suspend mode enables the device to enter alow power mode if no activity is detected for more than 3 mS. Any busactivity will keep the device out of the suspend state. When the deviceis in suspend mode it must draw less than 500 uA. CPU Ports A and C areconfigured as outputs, and set to high, when entering suspend modebecause as inputs each pin of ports A and C will draw 50 uA due to theinternal pull-up resistors on these ports. CPU Port B does not containany internal pull-up resistors but external pull-up resistors areimplemented in hardware at the optocoupler phototransistor output. Thusall port B CPU pins should be configured as outputs and set to highapplied before entering Suspend mode. Disabling the Analogue to Digitalconverter will save some current in suspend mode. In suspend mode thecurrent drawn by the guitar (3, 14, 24, 41) must be less than 500 uA.

Entering Suspend Mode

-   1. Make PA1 output high-   2. Make PA2 output high-   3. Make the following port pins and outputs HIGH PA0, PA3, PA4, PA5,    PA6, PA7, PB0, PB1, PB2, PB3, PB5, PB6, PB7, PC0, PC1, PC2-   Note: leave PB4 as an input always    Exiting Suspend Mode

The product can be woken up from suspend mode by switching the bus stateto the resume state, by normal bus activity, by signalling a reset or byan external interrupt. During suspend mode the internal CPU oscillatoris turned off. In this state the CPU will not be able to detect keypresses.

Leaving Suspend Mode

-   1. Make the following port pins Inputs-   PA0, PA3, PA4, PA5, PA6, PA7, PB0, PB1, PB2, PB3, PB4, PB5, PB6,    PB7, PC0, PC1, PC2 2.-   Make PA2 output LOW-   3. Make PA1 output LOW-   Guitar (3, 14, 24, 41) will only be in suspend mode:—-   a) When not configured in the PC-   b) When told to do so by the PC-   c) When there is no bus activity    CPU (U1)

The CPU (U1) is a ST7263 manufactured by ST Microelectronics. The CPUversion is a surface mounted type called ST72T631K4M1. The CPU clock isset by a 24 MHz crystal (A)

Switches SW1 to SW12

There are a total of 12 push button switches (normally open) connectedto the CPU. Each switch is monitored by 1 separate input. Each input isjoined to +5 volts via a pull-up resistor. When a switch is pressed theinput will drop from +5 volts to 0 volts.

Opto Switch OPT1 and LED1

OPT1 is a phototransistor which is switched on when LED1 (red LED) ison. LED1 shines light on OPT1. OPT1 is switched off by cutting the lightbeam with your thumb.

U2

This IC protects the CPU from any spurious signals picked up by theexternal wire. USB004 is a Chinese recommended part.

U3

This IC is a low power Op amp TS931 ILT. (ST Microelectronics). It isused to amplify the signal from the magnetic pickup.

J1 and J2 (3.5 mm Jack Sockets)

J1 or J2 allow for an input from a standard variable resistor footpedal. The middle connection is the wiper of the potentiometer. Atypical value for this potentiometer is approx. 22 k ohms

Bill of Materials Qty Description 1 SMT resistor 1.5 ohm 0.125 w 5%tolerance 1 SMT resistor 150 ohm  0.25 w 5% tolerance 5 SMT resistor 330ohm 0.125 w 5% tolerance 3 SMT resistor 1k5 0.125 w 5% tolerance 14 SMTresistor 4k7 0.125 w 5% tolerance 2 SMT resistor 10k 0.125 w 5%tolerance 1 SMT resistor 22k 0.125 w 5% tolerance 1 SMT resistor 150k0.125 w 5% tolerance 2 SMT resistor 220k 0.125 w 5% tolerance 1 SMTresistor 1 Mohm 0.125 w 5% tolerance 1 47k potentiometer (VR1) 10%tolerance 2 SMT capacitor 33 pF ceramic 50 v 5% tolerance 5 SMTcapacitor 0.1 uF ceramic 23 v 10% tolerance 1 SMT capacitor 0.47 uFceramic 16 v 10% tolerance 2 SMT capacitor 10 uF 16 v tantulum oraluminium electrolytic 1 Red LED 204SRC/E 1 opto transistor(OPT1)PT928-6C 1 SMT 24 mHz crystal AEL CM309S 2 1N914 diodes 1 CPU (U1)ST Microelectronics ST72F63BK4M1 (SMT Shrink package SO34, 300 milwidth) 1 protection chip (U2) USB004 (SMT package) 1 op amp TS931 ILT(ST Microelectronics) 12 SMT switches (normally open) Omron B3S-1000 5Tranducers 1 USB screened cable 3 metres long with series ‘A’ Plug

Port No.s for the Guitar PIN No. INTERNAL (PACKAGE IS PULLUP TYPE OFPORT SO34) INTERRUPT RESISTOR SIGNAL COMMENT 4 Switches at bottom(Bottom is SW1, Top is SW4 SW1 PA0 29(Input) no pullup res. Hi or Lo 0means key is pressed SW2 PA3 23(Input) no pullup res. Hi or Lo 0 meanskey is pressed SW3 PA4 22(Input) Ext. Int pullup res. Hi or Lo 0 meanskey is Lo to pressed Hi SW4 PA5 21(Input) Ext. Int pullup res. Hi or Lo0 means key is Lo to pressed Hi 8 Switches on neck Bottom is SW5 top isSW12 SW5 PA6 20(Input) Ext. Int pullup res. Hi or Lo 0 means key is Hito pressed Lo SW6 PA7 19(Input) Ext. Int pullup res. Hi or Lo 0 meanskey is Hi to pressed Lo SW7 PB2 16(Input) no no Hi or Lo 0 means key ispressed SW8 PB7 10(Input) Ext. Int no Hi or Lo 0 means key is Hi topressed Lo SW9 PC0  7(Input) no pullup res. Hi or Lo 0 means key ispressed SW10 PC1  6(Input) no pullup res. Hi or Lo 0 means key ispressed SW11 PC2  5(Input) 0 means key is pressed SW12 PB6 11(Input)Ext. Int no Hi or Lo 0 means key is Hi to pressed Lo Ground pin for allPA1 28(Output) no pullup res. Hi or Lo Set to 0 to allow 12 Switches and(25 mA port) all switches SW1 opto to SW12 and device opto1 to be SW1 toSW12 and detected opt1 Set to 1 in suspend mode Red LED2 for PA224(Output) no no Hi or Lo Set to 0 to light OPT1 (25 mA port) LED OPT1PBO 18(Input) no no Hi or Lo 1 means light is blocked VR1 pot (Wow PB315(Input) no no analog pot) i/p From Amplifier PB4 14(Input) Ext. Int noanalog U3 Lo to i/p Hi 3.5 mm Jack socket PB1 17(Input) no no analog(J1) for Foot pedal 1 i/p 3.5 mm Jack socket PB5 12(Input) Ext. Int noanalog (J2) for Foot pedal 2 Lo to i/p Hi

The above schematics and explanation are shown for example purposes onlyand the invention is not limited in its scope by the operation of theschematic design, the components used or the specification orcapabilities of the components or the range of additional peripheraldevices which could be added to the design. The design is not limited tothe number of control members (switches) or magnetic pick-ups, lightsetc. shown in these schematics.

Particular attention should be drawn to FIG. 9, Label K. The schematicshows the circuit for a standard multi-pole transducer which provides asingle output energy source irrespective of the fact that one or anycombination of strings 42 are activated. This invention uniquelyspecifies the use of a plurality of individual, uncoupled, isolatedtransducers that will only be energised by the activation of theindividual string 42 directly associated with that string.

Each transducer output would be connected to a separate pin on the CPU,in a similar fashion to that described in the schematic FIG. 8 and FIG.9, which are shown as example only. The CPU would perform an analogue todigital conversion (A/D) on the sampled input. In the situation wheresufficient A/D resources are not available on the CPU an external A/Dconverter would be required. Another alternative would be to bank switchgroups of inputs, be they analogue (e.g. Transducer output) or digital(e.g. Push button). For example, assuming there is a requirement to read16 analogue inputs, these inputs could be connected to a multiplexingdevice whose 8 output pins are connected to the CPU. Another pin fromthe CPU would control (bank switch) which bank of 8 inputs are directedto the CPU.

The two foot-pedal jack sockets shown in FIG. 9 and described in theschematic workings will allow users to dynamically modify a variablecontrol, for example volume, pan or special effect parameters controlsas described later in this application. The individual transducers(magnetic pick-ups) are one method of detecting string 42 vibrations.The invention is not limited to the use of any specific tranducer typesuch as piezo crystal, piezo film, piezo ceramic opto-detection methods,pressure sensing, movement detection et al. could also provideacceptable solutions for sensing the vibrations, and amplitude of thevibrations. The preferred type of transducer is a piezo-electrictransducer selected from a group consisting of piezo-electric crystaltransducers, piezo-electric ceramic transducers and piezo-electric filmtransducers.

Preferably the Interactive multimedia apparatus, see FIG. 5 as anexample, would include a series of coloured LED lights under each string42, located at the neck end. The software activates the lights under theindividual strings 42 which make up the selected chord, so that the userwill be notified of the correct strings 42 to strum and if they so wish,they can pick the individual notes of the selected chord. This componentof the application will be dealt with in more detail later in theapplication.

In use, the invention may be as follows;

Usually chords are played on a stringed instrument by the placement ofthe user's fingers on the selected strings 42 in the appropriate sectionof the fret on the neck piece and then the user activates the strings 42in a manner that produces the desired sound output with thecorresponding vibration amplitude and duration. The user may strum,pick, strum up, strum down, strum and pick, pick between selectedstrings 42 etc. to achieve their desired results. The correct fingeringposition on the fret for each string 42 is a critical component in thegeneration of each note in the overall chord structure.

Asian Pacific, European and USA music compositions use 3 note chordsextensively, with the more accomplished, creative and dynamicinstrumentalists using more complex chord combinations of 4, 5 and 6notes to provide a more complete and colourful signature to theirplaying. 3 note chords can also have many combinations of individualnotes from within its own scale, which provide the user with a richpalate of chords from which to select.

If we take as an example only, the ‘C Chord’ and referring to FIG. 10;The diatonic C scale is as follows: C C^(♯) D D^(♯) E F F^(♯) G G^(♯) AA^(♯) B C D^(♭) E^(♭) G^(♭) A^(♭) B^(♭)D^(♭) is the same note as C^(♯) and the other b(flat) notes areequivalent of the ♯ (sharp) notes.

D^(b) is the same note as C^(#) and the other b(flat) notes are theequivalent of the # (sharp) notes.

The three note chords or triads for the C scale are C, E, G; for Cm theyare C, E^(b), G, for CSus4 they are C, F, G; for Cm65 they are C, E^(b),G^(b); for C+they are C, E, G^(#). It is obvious that for each notethere is a multiplicity of chord associations for the user to create orselect from. It is nearly impossible for the non-accomplished user tocreate the more complex chords, particularly those using 4, 5 or 6 notecombinations.

Many users with limited experience and training have been able to createsimple compositions using 3 chords variations. They can use the chordsof the root note of that key and the chords of the fourth and fifthnotes of the scale of the root note. Limiting the creative andentertaining experience to 3 or a small number of chord combinations ismost frustrating and irritating to users. To progress beyond the simple“3 chord trick” combination requires a lot of learning and practice withfret fingering etc. This invention eliminates the complexity of correctfret fingering, simple chord creation, complex chord creation, learningnote combinations associated for simple and complex chords etc.Additionally this invention will quickly teach the user if they wish tolearn, the correct notes associated with each chord they select andmoreover the user is shown which string 42 has triggered each note ofthe selected chord.

This invention allows users to quickly create and render an unlimitednumber of combinations of simple and complex chords, where each note ofthe chord is rendered at its correct interval in the chord structure asit would be played by an accomplished user of a stringed instrument.

Additionally, this invention will allow the user to play complexarpeggios as the notes associated with each arpeggio are stored on fileand are assigned by the software to the correct string position.

The chord generation and note rendering methodology for string-basedinstruments and that of keyboard-based instruments differ greatly. Withkeyboard-based instruments, the user usually plays a chord bysimultaneously depressing the keys of the associated notes of the chord.It is not normally possible for the user of a stringed instrument tostrum or to pick each note of a chord simultaneously whilst fingeringthe notes on the fret. This is because there is a time differenceinterval between the triggering of each note of the chord. Thisinvention allows for this time difference interval, as the chord storecontains the correct location of each note of the selected chord andthen assigns each note to the correct string position on the interactivemultimedia apparatus. Therefore, as each individual transducer's energylevel is detected for each string activation, the individual notes ofthe chords are rendered as the corresponding string 42 is activated. Inthis way the user is provided with a true representation of anaccomplished player's experience.

The LED visual displays under each string 42 will be energised by theapplication software to indicate to the user the active strings 42 forthe selected notes of the chord. The provision of the LED display is toallow users to visibly see the different note assignments to each stringfor each chord combination. The software can apply appropriate notes tothe unassigned strings 42 to simulate the sounds that these unassignedstrings 42 would make if the user wishes to strike across the whole ofthe string area in a violent action similar to the action of theirhard-rock idols. The user can chose from a set-up menu, whether theywish to configure the device for violent actions and have the softwareautomatically trigger the correct sounds for the unassigned strings 42.

The activation of the strings 42 resulting from the user actions will beinterpreted by the software to produce a sound output that trulyreflects the user's striking actions.

The user experiences described above are achieved using the techniquesdescribed as follows:

In this embodiment, the Interactive Multimedia apparatus (1, 11, 21) has12 control members, refer to FIG. 5, 44, which shows only 4 controlmembers 44 as an example only, and any number of additional controlmembers 44 for other assignments.

The transducer specified in this application will comprise five innumber (as example only and not limited to this number) individual,uncoupled and electrically isolated transducers, which provides for fiveseparate electrical outputs as a response to the user's activation ofthe individual string 42.

For example purposes only we will describe how the user will interactwith the software to simulate similar results to those achieved by anaccomplished instrumentalist.

Accordingly there is provided a store of recorded instrument notes froma plurality of stringed instrument types. A chord store is providedwhich contains the note associations for a very wide range of definedchord structures. The users, if they so wish, can additionally createtheir own bespoke chords or note associations, by selecting anassociation of notes and defining their string associations.

This chord store will provide the note associations for a very wideselection of known chord and scale definitions and structures. Tosimulate the playing of a stringed instrument using the Interactivemultimedia apparatus (1, 11, 21) and its associated software applicationprogram, demands the faithful reproduction of the selected instrumentsound in complete and total harmony and sympathy with the user'sactions. It is imperative that the chord store contains the exact stringassignment for each note in the chord so that the action of strumming orpicking the chord will trigger the notes in the correct order that theywere played by the user. In this invention, the store which has beencreated contains the note associations and the string assignments foreach chord contained in the store. Additionally, by user selection, thechord store may assign complimentary and sympathetic notes to any or allof the unassigned strings 42. The assignment of sympathetic notes tounassigned strings 42, will provide a more colourful and verbose chordrendering.

Accordingly, if the user wishes to render a chord, for example the chord‘C’, the user would firstly select the instrument file as shown in FIG.11 Label A and then select the chord ‘C’ from the chord store for theselected instrument type, see FIG. 10 Label A. The user would then bepresented with a drop down menu of all the C chord variations held inthe store, for example purposes only see FIG. 10 Label A. The user maywish to select the major chord, FIG. 10 Label B, which contains thenotes C, E, G. The chosen chord must then be assigned to a controlmember, see FIG. 5, reference numeral 44, which will select that chordwhen the user activates that control member 44. The chord assigned tothat control member 44 will be rendered by the software when the useractivates the strings 42 of the Interactive Multimedia apparatus (1, 1,21). The software will have automatically assigned the notes of theselected chord to the appropriate strings 42 of the interactivemultimedia apparatus (1, 11, 21) so that the individual transducerassociated with each string 42 will detect the user's actions instriking the string 42 and provide an audio output for the associatedassigned note that will faithfully represent the response to the user'sactions.

String assignments for the Simple D major chord would be String 1, NoteF^(#); String 2, Note D and String 3, Note A. If the user haspre-selected the option to apply an additional note, then the softwarewill add a further note ‘D’ to the 4^(th) String.

The user can assign chords and special effects to the control members44, which for example purposes only will be illustrated as follows; theuser will select from a window, see FIG. 12 Label A, the particularchord they wish to assign to a control member 44. The user is thenpresented with a menu as shown in FIG. 13. The user must select thedevice type from a plurality of devices, as shown in FIG. 13 Label A.For example purposes only we show a guitar-type device called the‘PikAx’ in FIG. 13 Label A. The user must then select the device numberthey wish to be configured, see FIG. 13 Label B. This application allowsfor a plurality of devices in each class of device and for a pluralityof different device classes. The user will then select from a drop-downmenu, see FIG. 13 label C, containing various control member identifieroptions. The user specifies which control member they wish to assign theselected chord to. For example purposes only, we show in FIG. 13 LabelC, the control member being identified as Switch 10, See FIG. 5,reference numeral 44. The user will then select the electrical state thecontrol member 44 must reach to be in the state of assertion for theselection of the assigned chord, as shown for example purposes only inFIG. 14 Label A. The drop-down menu as show in FIG. 14 Label Aillustrates for example purposes only, four conditions ofassertion—‘when pressed’, ‘when released’, ‘while pressed’ and ‘whilereleased’. The user will then select the triggering method for thecontrol member, see FIG. 14 Label B, which when asserted will providethe stimulus to the software to render the notes of the chord in directresponse to the software's interpretation of the control membersvibrations or activations. In some device class types, the activationsource may not be a vibrating mechanism, but some other pressure sensingdevice, an opto-coupled device or any other transducer, which providesan electrical output in response to a user's actions.

In this example we show in FIG. 14 Label B that a vibration sensitivetransducer is the selected activation device for triggering the notes ofthe assigned chord. The user may wish to adjust various effects,controls, characteristics or parameters of the sound output by usingeither a fixed or adjustable control member (42, 44, 45, 46). In FIG.15, we show for example purposes only, a range of controls that the usermay wish to adjust dynamically by using one of the dynamic range statecontrol members (42, 45, 46) shown in FIG. 19 Label A or by using any ofthe limited state control members 44 shown in FIG. 13 Label C. The usermay wish to increase the output volume, see FIG. 15 Label A; the pancontrol, see FIG. 15 Label B; the tempo, see FIG. 15 Label C or anyother control or parameter they may consider is desirable to adjustdynamically. In this example, for a limited sate control member 44, theuser will assign the selected control member 44 for the controladjustment by selecting from the drop-down menu, FIG. 15 Label B andthen selecting the assertion state for that control member FIG. 15,Label E and then selecting the percentage adjustment they wish to apply,FIG. 15 Label F and also the rate of change in milliseconds at whichthey wish to apply the change, FIG. 15 Label G. Similarly to reduce thevolume, pan, and tempo the user selects and assigns the controls asshown in FIG. 15 Label H, J, K, L.

When using an adjustable control member (42, 45, 46), the user willselect and assign the appropriate control members, FIG. 15, Label M, N,P. The user may wish to mute the output by selecting and assigning thecontrol member and their assertion states, see FIG. 15 Label R and S.The user may wish to restore the original settings by selecting andassigning a control member, see FIG. 15 Label T and V. Anothersignificant and unique component of this application is the ability ofthe software to dynamically and in real time, adjusts the individualparameters of a special effect, which is being applied to an individualnote or notes of the selected chord, while it is being rendered by thecentral control unit. In this application and for example purposes only,we show in FIG. 16 Label A, a range of special effect choices from whichthe user may select and which they may apply dynamically to a chord ornote or a combination of notes. In this example, we show that the userhas selected ‘flanger’, see FIG. 16 Label B. FIG. 17 shows, as exampleonly, some of the key parameter adjustments that affect the generationof the ‘flanger’ special effect. The user may adjust any or all of theseparameters to provide a composite sound effect of their choice.Additionally the user may wish to dynamically adjust in real-time duringtheir playing activity any or all of the individual parameters to createcontrasting sound effects. The user sets the individual slider controlsfor each parameter as in FIG. 17 to provide the composite sound effectresults they desire. The user will then assign the parameters they wishto adjust dynamically and in real-time as follows; the user wishes toadjust a parameter of the ‘flanger’ special effect and to have theselected parameter immediately activated in response to their operationof an adjustable control member. (42, 45, 46) FIG. 18 Label A shows aselection box, which when selected will tell the software toautomatically apply the adjustments when the selected control member isactivated. FIG. 18 Label B shows a drop-down menu containing theindividual parameters of the special effect being applied as in FIG. 17.The user selects the individual parameter they wish to dynamicallyadjust and in this example it is the frequency. The user will thenassign the adjustable control member they desire as the triggermechanism, see FIG. 19 Label A. In this example, it is a foot-pedal.Additionally there is allowance, as in FIG. 19 Label B, for the user toselect a minimum threshold level before the adjustable control member(42, 45, 46) kicks in. Setting this minimum threshold level in theactivation of the parameter adjustment allows for differing tolerancesin the electrical properties of proportional potentiometers and otherproportional measurement devices.

When the user activates the selected control member (42, 44, 45, 46),which in this example is a foot-pedal, beyond the minimum thresholdlevel of 5%, then the software will adjust the frequency parameter ofthe effect in sympathy with the movement of the dynamic range statecontrol member (42, 45, 46).

Additionally there is provided further embodiments of this invention,which provides an entertaining, but less challenging and lesseducational experience for the user. In this further embodiment, thechords would be rendered by the software in response to the userstriking any of the strings 42 of the interactive multimedia apparatus(1, 11, 21), in any sequence of strumming, picking etc. In this furtherembodiment, the notes of the chords are not rendered as a response tothe individual string 42 activation as described in the earlierembodiment. This embodiment may be a starting position of choice forbeginners, who would quickly progress to the more advanced embodiment asdescribed earlier in this application. In this embodiment, the user mustselect the preferred tempo they wish to use. The software will triggerthe rendering of the notes of the selected chord at time intervalsappropriate to the selected tempo.

Additionally, the chord store is not restricted to the notes of avariety of string instrument types. The chord store could include notes,chords or sounds from any instrument type or from any percussion typeinstrument or from any wind-based instrument or from any reed-basedinstrument or from any instrument that is activated by a bow movement orfrom any device that comes within the classification of a musicalinstrument, which would be rendered as either individual notes, chordsor sounds or combination of sounds by user selection. This invention isnot limited in any way by the examples provided in this application orto the instrument types or to the method of application or stimulation.

It is to be understood that the invention is not limited to the specificdetails described above which are given by way of example only and thatvarious modifications and alterations are possible without departingfrom the invention as defined in the appended claims.

1. An interactive multimedia apparatus (1, 11, 21) comprising:— adigital musical instrument (3, 14, 24, 41) having a plurality of controlmembers (42, 44, 45, 46) including at least one limited state (ON/OFF)control member (44) and at least one dynamic range state control member(42, 45, 46); a central control unit (2, 12, 22) having a store ofdigital media stored thereon and a suite of software for interpretingthe state of the control members (42, 44, 45, 46) in order to select,open and render the digital media; a control unit associated with thedigital musical instrument (3, 14, 24, 41) having a CPU and a sensingmeans for identifying the state of the control members (42, 44, 45, 46),the control unit having means for communicating the current state of thecontrol members (42, 44, 45, 46) to the central control unit (2, 12, 22)and means for communicating between the central control unit and theCPU; the sensing means comprising a plurality of independent transducerseach of which monitors the activation of a separate dynamic range statecontrol member (42, 45, 46).
 2. An interactive multimedia apparatus (1,11, 21) as claimed in claim 1, wherein the independent transducers areselected from a group of electrical, optical, pressure, movement,magnetic and piezo-electric transducers.
 3. An interactive multimediaapparatus (1, 11, 21) as claimed in claim 2, wherein the piezo-electrictransducer is selected from a group consisting of piezo-electric crystaltransducers, piezo-electric ceramic transducers and piezo-electric filmtransducers.
 4. An interactive multimedia apparatus (1, 11, 21) asclaimed in claim 1, wherein the digital musical instrument (3, 14, 24,41) is a guitar/guitar type device.
 5. An interactive multimediaapparatus (1, 11, 21) as claimed in claim 1, wherein a number of thedynamic range state control members (42, 45, 46) are strings (42) of astringed instrument (3, 14, 24, 41).
 6. An interactive multimediaapparatus (1, 11, 21) as claimed in claim 5, wherein each independenttransducer monitors one individual string (42) and converts movement ofthe string (42) into electrical signals.
 7. An interactive multimediaapparatus (1, 11, 21) as claimed in claim 1, wherein at least onedynamic range state control member (42, 45, 46) is a foot pedal.
 8. Aninteractive multimedia apparatus (1, 11, 21) as claimed in claim 7,wherein one or each foot pedal is monitored by a potentiometer.
 9. Aninteractive multimedia apparatus (1, 11, 21) as claimed in claim 7wherein activation of the foot pedal dynamically modifies a variablecontrol such as volume, pan or special effect parameter controls.
 10. Aninteractive multimedia apparatus (1, 11, 21) as claimed in claim 1,wherein the central control unit (2, 12, 22) has a visual display unit(V.D.U.) and the suite of software has a graphical user interface(G.U.I) displayable on the V.D.U.
 11. An interactive multimediaapparatus (1, 11, 21) as claimed in claim 10, wherein the control unitof the digital musical instrument (3, 14, 24, 41) has a control panel(48) comprising a plurality of limited state control members (44),namely switches for navigating through the G.U.I. of the software suite.12. An interactive multimedia apparatus (1, 11, 21) as claimed in claim11, wherein the central control unit (2, 12, 22) has memory for storinguser assignments of digital media against specific control members (42,44, 45, 46), the memory being accessible by a software module of thesoftware suite in response to activation of a control member (42, 44,45, 46) or by activation of a combination of one or more limited stateor dynamic range state control members (42, 44, 45, 46) to open, render,modify, adjust, add effects, change parameters and change controls ofthe rendered digital media.
 13. An interactive multimedia apparatus (1,11, 21) as claimed in claim 1, wherein indicators are provided on thedigital musical instrument (3, 14, 24, 41) and are controllable bysoftware on the central control unit (2, 12, 22) in response to anassignment of digital media against specific control members (42, 44,45, 46) by a user, the indicators being provided to show the user whichof the dynamic range state control members (42, 45, 46) have beenassigned to produce an audio/visual output if activated.
 14. Aninteractive multimedia apparatus (1, 11, 21) as claimed in claim 13,wherein the indicators are a plurality of light emitting diodes disposedon the digital musical instrument (3, 14, 24, 41) below each string(42), each L.E.D. being associated with one string (42).
 15. Aninteractive multimedia apparatus (1, 11, 21) as claimed in claim 1,wherein at least one limited state (on/off) control member (44) and atleast one dynamic range state control member (42, 45, 46) are provided.16. An interactive multimedia apparatus (1, 11, 21) as claimed in claim1, wherein between one and sixteen limited state (on/off) controlmembers (44) and between one and twelve dynamic range state controlmembers (42, 45, 46) are provided.
 17. An interactive multimediaapparatus (1, 11, 21) as claimed in claim 1, wherein each control member(42, 44, 45, 46) is associatable with any file stored in the store ofthe central control unit (2, 12, 22).
 18. An interactive multimediaapparatus (1, 11, 21) as claimed in claim 1, wherein at least some ofthe digital audio files are recorded instrument notes of a plurality ofstringed instrument types (3, 14, 24, 41).
 19. An interactive multimediaapparatus (1, 11, 21) as claimed in claim 1, wherein the store furthercomprises a chord and scale store of digital media containing the noteassociations for a wide range of defined chord and scale sequences, thestore also defining the correct note associated with each stringposition for the selected chord or limited scale sequence so that thenotes are played in the correct sequence when the strings (42) arestrummed up or down.
 20. An interactive multimedia apparatus (1, 11, 21)substantially as herein described with reference to and as shown in theaccompanying drawings.